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Technology and change are so closely related that the use of the word innovation 
seems synonymous with technology in many contexts, including that of higher 
education. This paper contends that university culture and existing capability 
constrain such innovation and to a large extent determine the nature and extent of 
organisational change. In the absence of strong leadership, technologies are simply 
used as vehicles to enable changes that are already intended or which reinforce the 
current identity. These contentions are supported by evidence from e-learning 
benchmarking activities carried out over the past five years in universities in the 
United States, the United Kingdom, Australia and New Zealand. 
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Introduction 

Educational technology is a field based on change. (Surrey 2005, 933) 

Investment in technology systems by universities is driven by the expectation that 
increased use of technology will improve the quality and flexibility of learning (Bates 
2001; Bush 1945; Cuban 2001; DfES 2003; Oppenheimer 2003; Ryan et al. 2000). 
This investment has been supported by the widespread adoption of Learning Manage- 
ment Systems and the computerisation of key administrative functions (Hawkins and 
Rudy 2006, 52; Zemsky and Massy 2004), and the maintenance of an effective 
technology infrastructure remains a key strategic focus for university leaders (Allen 
and Seaman 2008; McCarthy and Samors 2009). 

However, while information technology systems have become mainstream, and 
even strategically irrelevant for many activities (Carr 2003; Chester 2006), changes in 
the experience of learning and teaching enabled by technology are less apparent. As 
educational technologists we share a common belief that technology can significantly 
improve the experience of learners and teachers. That belief has seen the field of 
educational technology progress from an initial naivety that simply introducing tech- 
nology would improve the learning experience. Many institutions have attempted 
variations on early adopter innovation projects, invested in substantial infrastructures, 
and consequently developed an awareness of the need for formalised and systematic 
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professional development. Beyond the focus on the individual teacher we also have 
the rhetoric of organisational change, perhaps best expressed by Fullan: 

The answer to large-scale reform is not to try to emulate the characteristics of the minor- 
ity who are getting somewhere under present conditions ... Rather, we must change 
existing conditions so that it is normal and possible for a majority of people to move 
forward. (2001, 268) 

This awareness of the role of organisational change is not recent, with the need to 
go beyond the pedagogy and technology to consider organisational aspects (Bates 
2001; Ryan et al. 2000), leadership (Hanna 1998; Reid 1999) and systems (Ison 1999; 
Laurillard 1997, 1999; Peters 1999) recognised. Those leading change in universities 
need to balance technological, academic and administrative concerns (Jones 2003; 
McCarthy and Samors 2009). These include the strategy and culture of the organisa- 
tion (Laurillard 1997; Reid 1999; Remeyni, Sherwood- Smith, and White 1997), 
resource utilisation (Karelis 1999), sustainability (Strauss 2002; Young 2002), 
scalability and reusability (Bain 1999; Boyle 2003; IEEE 2002). 

This paper explores evidence from e-leaming benchmarking activities carried out 
over the past five years in universities in the United States, the United Kingdom, 
Australia and New Zealand in an attempt to understand the nature of university change 
in response to technology. 


Organisational change as a theoretical construct 

Simple understandings lead to general rules to be applied in all situations; complicated 
understandings suggest that situations differ and that reliance on experiences of the past 
may prove dysfunctional. [...] Only complicated understandings can see the many and 
conflicting realities of complicated situations. (Birnbaum 1988, 209) 

Change in large complex organisations can be described as operating at multiple 
levels: process, systems, structures, organisations and institutions (Seel 2007; Waks 
2007). Process and systems change happens frequently as new ideas, technologies or 
capabilities become available within an organisation and can be driven by individuals 
or small groups within the organisation. When these changes are not disruptive to the 
work of other systems and structures, they can be described as interoperable change. 
Historically, structural and organisational change has been managed as a discontinu- 
ous process with organisations undergoing a period of instability and change before 
returning to periods without change. 

Birnbaum (1988) suggests that change can occur more effectively if universities 
are managed according to the principles of cybernetics, what Stafford Beer called the 
science of effective organisation. Structures within the organisation are then organised 
in a loosely coupled manner (Weick 1976). 

Christensen, Anthony, and Roth (2004) identify three types of organisational 
change. ‘Sustaining’ changes are ones that improve the function of the organisation in 
ways that are consistent with previous activities. Putting lecture handouts on a Learn- 
ing Management System rather than expecting students to pick up a physical copy 
from an office is an example of a sustaining change. ‘Disruptive’ changes create new 
markets or reshape existing ones. ‘Low-end disruptive’ changes can occur when the 
existing product exceeds the needs of some consumers. For example, many people 
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obtaining degrees might be well served by less comprehensive providers with fewer 
subject options but also significantly lower fees. ‘New market disruptive’ change can 
occur when consumers are limited by the capability or complexity of existing prod- 
ucts. Online delivery of degrees is potentially a new market disruption, although the 
lack of success of virtual universities to date illustrates the challenge facing providers 
attempting to realise that potential (Cunningham et al. 2000; Zemsky and Massey 
2004). 

Disruptive change is problematic for dominant organisations as the natural 
tendency is to protect existing structures and activities, particularly when those are 
currently seen as successful. It is important to emphasise that technology is by default 
neither sustaining nor disruptive in nature. The use of the Internet to deliver courses 
can be a low-end disruptive change to universities when implemented by an organisa- 
tion to undercut the costs of obtaining a basic degree; or simply a sustaining change 
when used by an existing distance university to supply electronic rather than paper 
documents. Christensen, Anthony, and Roth (2004, 126) contend that the use of the 
Internet to deliver university education has failed in many cases as it has been used to 
deliver an inferior experience in competition to the existing model to the same group 
of students, rather than to current ‘non-consumers’. They suggest that such failures, 
rather than being the result of poor course design, are the result of a misidentiflcation 
of the market for such courses. 


Must universities change and should change be a response to technology? 

An obvious question to ask is whether universities need to and should change in 
response to external forces, including technology. As an institution of society (Waks 
2007), the university has existed for centuries. A university degree is considered an 
essential qualification for many young people, and accredited degrees offer many 
international opportunities for those who wish to travel and work. The stability of the 
institution and the apparent resistance to change may reflect the value to society of the 
institution in its current form. 

One obstacle to change may be the lack of strong evidence that technology is bene- 
fiting educational outcomes for students (Conole, Oliver, and Harvey 2000; GAO 
2003; Kenny 2001; Means et al. 2009; Radloff 2001; Taylor 2001a; Zemsky and 
Massy 2004). While this is most probably a result of poor research design and the 
challenge of collecting empirical evidence of improvement in student learning 
outcomes, it does make it harder to justify the expense and disruption of change to 
sceptical organisation leaders, colleagues and other stakeholders. 

There is also the need to consider the purpose of change. Much of the recent 
change evident in universities has been driven by financial accountability for public 
funds. The university has a range of purposes, participants and audiences, all of whom 
apply pressures for change to better suit their needs or resist changes that disrupt their 
perception of the university as an institution (Kerr 2001; Marginson 2004). Perkins 
(1973, 12) recognised that these conflicting purposes challenge universities, prevent- 
ing the use of simple measures of performance such as profit, while there is also the 
internal conflict between structures that most efficiently support research with those 
that integrate research with education. 

Despite these internal complexities, the forces driving change are such that univer- 
sities cannot ignore the implications. Governments are acutely conscious of the need 
to educate adults failed by existing institutions (HCPAC 2009), and internationally 
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there are many countries seeking solutions to the problem of educating a population 
without the resources or opportunities of university education (Daniel, Kanwar, and 
Uvalic-Trumbic 2009). Christensen’s model predicts that the risk for universities lies 
in the emergence of new institutions and organisations that meet the needs of these 
non-participants (Christensen, Anthony, and Roth 2004). It is a short step from 
serving this group to more cheaply and efficiently serving significant proportions of 
the university’s current student population. 

Beyond the social drivers for change, there is also the rapid pace of technological 
change. Our society is likely to experience the same level of technological change in 
the next 100 years as it experienced in the past 20,000 years (Kurzweil 2005, 50). 

Taylor (2001b) observed that the challenge facing universities trying to best use 
technology for education is not so much about the innovation itself. Key is the execu- 
tion of the change; the need for the organisation to rapidly evolve to sustain the execu- 
tion of change at the same increasing pace at which new technologies are developed. 

The ubiquity of technology, combined with ever decreasing costs, means that the 
use of the technology itself is increasingly not a distinguishing factor for organisa- 
tions, but rather the quality of that use and the way it advances the goals of a change- 
resilient organisation become essential to success (Carr 2003; Hamel and Valikangas 
2003). Organisational leaders need to distinguish the products of change, the visible 
uses of technology, from the processes that result in their use. Demers (2007, 34) 
identifies from the work of DiMaggio and Powell (1983) three mechanisms that 
drive institutional change and which can influence processes for change within 
organisations: 

• coercive isomorphism, which explains change as a consequence of formal or 
informal pressures imposed on organisations externally; 

• mimetic isomorphism, which describes the tendency for organisations to adopt 
‘standard’ or popular approaches in uncertain times; and 

• normative isomorphism, which is change that is driven by professionalism and 
the emergence of ‘legitimated professional practices’ that result in pressure for 
organisations to conform because their staff are able to draw on organised 
professional networks and professional standards that guide their activities. 

The last of these, ‘normative isomorphism’, is the form most consistent with the 
values of the collegial university institution. ‘Coercive isomorphism’ is the form that 
is most visible through the pressures placed by governments on (particularly public) 
universities to demonstrate economic benefits of their programmes and to minimise 
costs. ‘Mimetic isomorphism’ is seen in the restructuring work of consultants 
(McKinnon, Walker, and Davis 1999) and the adoption by universities of popular 
management fads. 

Coercive isomorphism and mimetic isomorphism both represent significant chal- 
lenges to the identity of universities as collegial, academic organisations. Resisting 
these forms of change behaviour requires strong leadership, an organisation with a 
strongly expressed collective identity, or both. 

Change within an organisation can be described as top-down (driven by manage- 
ment), bottom-up (reflecting emergent or participatory-driven change), or combina- 
tions of the two. Bottom-up initiatives are generally driven by individual ‘early 
adopters’ (Rogers 1995), and while substantial resources have been invested in such 
projects, wider adoption and use requires more than resources: leadership, systems 
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and a supportive climate for change are essential (Southwell et al. 2005). Strong lead- 
ership, aware of the dynamics and culture of their organisation, is vital, enabling 
creation of systems for change and providing the resources needed to enact new ideas, 
but even with leadership change can be challenging for universities. Bimbaum (1988, 
205) noted that leaders can drive significant change from the top most easily in univer- 
sities that: 

• are in a state of acknowledged crisis; 

• are small; 

• are conspicuously out of date; or 

• have autocratic leadership. 

Other than small institutions, these conditions cannot be seen as particularly 
desirable or consistent with the collegiality of the university institution. Clearly, 
universities need change strategies operating simultaneously and synergistically at 
multiple levels (Moore 2006; Russell 2009; Southwell et al. 2005). Maturity models 
such as the e-leaming Maturity Model described below attempt to make explicit these 
strategies and capture the extent to which they are evident in the activities of individ- 
ual organisations. 


Analysing the capability of universities to change with the e-learning Maturity 
Model 

The e-leaming maturity model (eMM) (Marshall and Mitchell 2002; http:// 
www.utdc.vuw.ac.nz/research/emm/) is a quality improvement framework based on 
the ideas of the Capability Maturity Model (Paulk et al. 1993) and the Software 
Process Improvement and Capability Determination (SPICE) framework (El Emam, 
Drouin, and Melo 1998; SPICE 2002). The eMM framework measures the capability 
of institutions to sustainably engage in technology-supported learning and teaching, 
and visualises that capability in a way that assists leaders and managers using that 
information to undertake systematic and targeted improvements in their organisation’s 
e-leaming activities. The eMM is intended to go beyond benchmarking to actively 
support organisational change activities. The maturity model theoretical construct is 
explicitly designed to encourage self-reflection and the improvement of organsational 
activities. 

Since the initial development, the eMM has been developed, refined and validated 
through a series of projects conducted in New Zealand (Marshall 2005, 2006a; 
Marshall and Mitchell 2006), Australia (Marshall, Mitchell, and Beames 2009), the 
United Kingdom (Sero 2007; Bacsich 2008; University of London 2008) and the 
United States (Marshall, Udas, and May 2008). The eMM assesses the ability of an 
organisation to ensure that e-leaming design, development and deployment is meet- 
ing the needs of the students, staff and the organisation itself on five dimensions 
(Figure 1). Rather than levels, which imply a hierarchical model of process improve- 
ment where capability is assessed and built in a layered and progressive manner, the 
concept underlying the eMM’s use of dimensions is holistic capability. Each process 
is assessed from the synergistic perspectives of ‘Delivery’, ‘Planning’, ‘Definition’, 
‘Management’ and ‘Optimisation’. 

The eMM divides the capability of institutions to sustain and deliver e-leaming 
into 35 processes grouped into five major categories or process areas that indicate a 
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Figure 1. eMM process dimensions. 
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shared concern. It should be noted, however, that all of the processes are interrelated 
to some degree, particularly through shared practices and the perspectives of the five 
dimensions. Each process in the eMM is broken down within each dimension into 
practices that define how the process outcomes might be achieved by institutions 
(Figure 2). The practice statements attempt to capture directly measurable activities 
for each process and dimension. The processes and practices are derived from an 
extensive review of the literature, international workshops and experience from their 
application (Marshall 2006b, 2008). 

The eMM promotes organisational change in this framework at three main levels. 
The most explicit is the Optimisation dimension, which is explicitly assessing system- 
atic change in the organisation. Beyond this, experienced practitioners undertake 
assessments using an adequacy scale that can easily evolve to reflect better knowledge 
about effective technology use. Finally, the processes and practices of the model are 
evolving, changing in subsequent versions to reflect the experience and evidence from 
international assessments and the literature (Marshall 2006b, 2008). 

Figure 3 shows a summary of the capabilities of a number of international univer- 
sities. The organisations shown range from very large to very small, from strongly 
teaching focused through to prestigious research-dominated universities. All of these 
universities describe themselves as modem organisations keen to take best advantage 
of technology to advance all of their activities. As a sample, they illustrate the range 
of organisational capability for the adoption and use of technology within the interna- 
tional university sector (Marshall 2009). The capability assessments shown here focus 
on e-leaming activities and do not directly assess other types of learning and teaching. 

The patterns of stronger capability (dark shading) and weaker (light shading) can 
be observed from this matrix. Each box represents a further summary of detailed 
practices for each dimension of the individual processes (rows) that can be used by 
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Figure 2. Relationships between processes, practices and dimensions. 
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Figure 3. eMM capabilities of international universities (Marshall 2009). 
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institutions as checklists or plans for improvement. Each column represents a single 
institution in summary, with five sub-columns for each of the five dimensions. 

Stronger capability can arise for a number of reasons. It may reflect existing 
systems essential to all forms of delivery. For example, process 08 (Figure 4) is 
relatively strong in all of these institutions, as a result of common administrative 
processes being used by these universities regardless of the mode of delivery. The 
strength apparent in process S2 (Figure 4) is similarly a result of the move to support 
technology use by all library users, not just those engaging in technology-mediated 
learning. In both of these cases, however, the lack of capability in the Optimisation 
dimension is evident, due to the absence of activities aimed at systematically improv- 
ing the experience of technology-mediated learners. 

Stronger capability may also be a result of activities being under the direct control 
of individual staff able to influence the experience of the students through their own 
work. This is apparent in the generally stronger capability of the Delivery dimension 
of the Learning process area and arises from the actions of individual teachers within 
their courses and programmes. The absence of capability in most institutions through 
the other dimensions shows the lack of institutional engagement with these same 
issues. 

Finally, stronger capability may also reflect dedicated investment of resources 
aimed at the process activities. This can be seen in the relative strength of process D5 
(Figure 5), which arises from the consistent and substantial investment in Learning 
Management Systems and the supporting infrastructure seen in most universities. This 
contrasts with process D6 (Figure 5), where the comparatively weaker capability 
results from the lack of formal engagement with standards and a dependence on a 
specific vendor’s products as default solutions. 

Weaker capability can reflect the reality that specific processes are not useful as 
currently formulated (i.e. process D7), but can also illustrate the absence of particular 
activities relevant to organisational change. The very weak capability of the Evalua- 
tion processes and the Management dimension of all processes result from the 
widespread lack of consultation with staff and students regarding their experiences of 
technology-mediated learning. Most institutions appear to operate on the implicit 
assumption that their systems and tools are sufficient and if there is an issue someone 
will complain. 


08: Students are provided with administratior 
information prior to starting courses 
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S2: Students are provided with library 
facilities when engaging in e-learning 
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Figure 4. University process 08 and S2 capabilities (Marshall 2009). 
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D5: All elements of the physical e-learning 
infrastructure are reliable, robust and sufficient 
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D6: All elements of the physical e-learning 
infrastructure are integrated using defined 
standards 
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Figure 5. University process D5 and D6 capabilities (Marshall 2009). 


The assessment data shown here can also be used to reflect on the types of organ- 
isational change these universities have demonstrated, and to suggest where opportu- 
nities and challenges await in the future. Figure 3 potentially represents a form of 
organisational change snapshot. The capability assessments summarising the impact 
of change that has occurred to date as these universities have worked to integrate 
technology into their activities, overlaid on the generic capabilities intrinsic to each 
organisation. 

The absence of a formal change mechanism promoting technology for learn- 
ing and teaching is evident in the lack of capability in the Definition dimension 
for most of these universities. This is a result of there being few formal 
processes, policies or staff development opportunities addressing the implications 
of technology use by these organisations. Individual institutions show different 
patterns of engagement with technology suggesting the change approach being 
used (either explicitly or implicitly). University NZ-A has a distinctly stronger 
capability in the Delivery and Planning dimensions of the Support process area, 
consistent with an approach driven by a focus on student support, independent of 
specific courses and programmes. In contrast, university NZ-B shows stronger 
capability in the Learning and Development areas, reflecting a formal design and 
development approach driven by a specialist team. The absence of capability in 
the Definition dimension for NZ-B, however, illustrates a common problem with 
the use of dedicated technologists, as there is no evidence of a mechanism 
transferring expertise to all teaching staff, limiting the impact by the size of the 
team of support staff. 

There is very little evidence of a culture of critical self-reflection within the organ- 
isational assessments, and this is shown in the almost complete absence of capability 
in the Optimisation dimension of most institutions. This is possibly linked to the weak 
Evaluation process and Management dimension capability noted above, but also prob- 
ably reflects the lack of attention by university leaders to these areas. This lack of 
leadership is also evident in the weak capabilities for processes 09 and 02 (Figure 6) 
in most of the institutions. This lack of strategic context is possibly one of principle 
reasons that technology has not driven organisational change, despite the opportuni- 
ties to do so (McCarthy and Samors 2009). 
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02: Institutional learning and teaching policy 
and strategy explicitly address e-learning 
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09: E-learning initiatives are guided by 
institutional strategies and operational plans 
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Figure 6. University process 02 and 09 capabilities (Marshall 2009). 


Conclusions 

Future technological developments will probably change the nature of the student 
experience and possibly disrupt the university as an institution of society, making 
existing organisational models and pedagogies unsustainable (Fledberg 2006). This 
paper contends that, more commonly and for the immediate future, the change result- 
ing from new technologies depends on the change culture and leadership decisions of 
the individual universities. 

The eMM is designed as a tool for supporting change informed by the benchmark- 
ing analysis. The analysis of the visualisations presented above provides the first step 
of a potential change process. The audience for this analysis encompasses all of the 
stakeholders, and the visual approach adopted is intended to make the initial question- 
ing of organisational capability a simple pattern-matching activity. Once a pattern has 
been identified, the eMM provides the details of the underlying practices that both 
provide a framework for assessment, but also a starting point for the development of 
action plans (Marshall 2006b). The practices are defined so as to enable organisations 
considerable flexibility in how the assessed outcome is achieved, supporting a range 
of pedagogies, technologies and other significant characteristics of the learning and 
teaching environment. 

The eMM does not, however, provide a specific, pre-defmed, mechanism for 
organisational change. The intention is to ensure that change is well-informed, 
facilitated by the ability to see areas of organisational strength and weakness, and that 
the impact of change initiatives be apparent in subsequent assessments. The underly- 
ing model of organisational maturity is descriptive of the characteristics of more 
effective institutions, but does not define or measure the path taken to achieve that 
outcome. 

The evidence from the eMM assessments presented in this paper suggest that, to 
date, decisions have been made primarily with the intention of engaging in ‘sustain- 
ing’ and ‘mimetic’ forms of change and that universities as organisations as yet show 
little capability to disrupt their existing educational models. An ongoing priority for 
the eMM research is testing this analysis, working with organisations changing to take 
advantage of new technologies, examining the ways which that work is seen in eMM 
capability assessments and verifying the utility of the eMM framework as a change- 
oriented quality improvement tool. 
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Laurillard (1997) identified over a decade ago the need to examine the limitations 
of current practices carefully so as to incrementally improve capability, but the lack 
of engagement with students and staff seen in these assessments and the weak assess- 
ments in the Optimisation dimension offer little evidence of critical self-examination. 
The UK Government, the Australian Government and the New Zealand Government 
have repeatedly imposed various performance indicator-reporting requirements on 
universities, but there is no evidence of a culture of systematic self-improvement driv- 
ing the examination and use of technologies for learning and teaching. Most of the 
universities assessed here have supported staff engaging in bottom-up, early adopter 
innovation, but have failed to provide systems and environments that result in wider 
adoption of successful ideas (Moore 2006; Russell 2009; Southwell et al. 2005). 

The implications for those interested in promoting change within the university as 
an institution are challenging. A clear avenue for further action is finding ways that 
the experiences of students and staff can be used to frame future technology supported 
organisational and pedagogical change. Beyond this there is a need for clearly articu- 
lated goals for change supported by, rather than led or in response to technology, or 
coerced by external drivers. Reasons for change enabled by and making effective use 
of technologies are needed that are relevant to the organisations and to the staff and 
students who, collectively with the leadership, create the university (McCarthy and 
Samors 2009). 

As a societal institution, universities need to grapple with the two types of disrup- 
tive change identified by Christensen, Anthony, and Roth (2004). University leaders 
need to be alert to the ways by which other organisations are meeting the educational 
needs of people who are not university students, and avoid the myopia common to 
dominant organisations (Levitt 1975). Universities may not be responsible for meeting 
the needs of all adult ‘non-consumers’ of higher education, but all stakeholders in the 
university institution need to be aware that others meeting those needs might also 
better meet the needs of many existing university students. New ‘low-end’ providers 
may lack prestigious reputations, and may well compromise some aspects of quality 
university learning, but only a very few universities can depend on their reputation and 
not respond to the demands of governments and students to deliver a more flexible and 
less expensive education. 
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